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Probleas with the Inf ora^t^os Exchange Procedures 
(IBP) developed by the National Center £6r Higher Education ' 
Qanag^ient Systems ^are discussed* lEP procedures analyze-student 
records, faculty effort, and amual expenditures. The particular . . 
anproad^ taken in the analysis of the student faculty .relationship 
has iftpoxfibant theoretical iprobleus, is too conplex and costly, and 
"^adds little significant ^insight^ for* use iOi uni'Versity' adainistratipn. 
The descriptive approach of lEP is based oh^ the faculty activity 
report vhicl^ has nuuerous validity problens"^ that destroy the 
potential use of its ikajor contribution: the calculation of unil: 
costs. The complex relationships betweei|^aculty an^ students, which 
causes of the costs, are concealed by this effort. The errors o'f 
■eaCsureaent chiefly center around the accuracy and ^validity x>t the * 
faculty activity reports auid the "representativeAss*^ of dat^ frou a 
particular tiae period. Additional terror resuljbs^roB problaus such 
as social security Batches between salary and f^ifsolty activity 
:l^j^gQy.4g.# pypgrap classi^^^ str octur e »a tche js^^jat wee A stud ent ^ 

"^^^r^ordir"aird^ f acuity act^ and the consistency across 

institutions of the types of operational decisions necessary in any 
large project. The complexity of the calculations used to produce the 
» indices serves to coupound the errors of aeasureaent of the inputs. 



♦ ^eprod actions -supplied by EDS^ are the be^t that can, be maide * 

* . frou the origineJ. docuaent. ' ' * 
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IBP ^ ProbJ^ms an4 Consequences 



"^Higher Education, in responding to societ&X jpressures in the 
^^^i^^^ of accountability and funding, has tried to find Vays 

"itJd i*^ productivity (defined here as dome miiasure of output 

: input by the stat^ , to compare the productivity and 

effitil^ncy of the institution to those of other states , and to 
find better ways of budgeting available resources (at both the ^ 
UnlYersity and Uni^^sity System level). 

For thtese reasons, several institutions have adopted , the 
.Information Exchfinge Procedures (lEPX developed by the National 
Center for Higher Education Management Systems (NCHEMS) . It offers ; • 
the 'advantages of, a nationally standardized expenditure analysis 
which produces reports showing institutional expenditures by 
activity (Program-Subprogram shown in Table 1) , average dollars C 
per credit hour? expended by departments (disciplines) at tiie various 
levels of instruction and the total and average dollars per credit 
hour spent* on each student degree program during the period under 

- study. It • is , however , . ^extremely conq)lex and expensive , especially 
in terms of staff and ccnnputing tlme^ to^run. Although much u 
Information is presented by the lEP software, it is the contention 
of th±9 paper that the particular approach taken in the -analysis of 
the student/faculty relationship has important theoretical probliems, 
is too complex and costly, and adds little significant Insight for 
use in university adhifnlsCyatlon . Specifically, lEP Is meirely a 
descriptive tool^ It does ^uerate . daiia which in turn has f^ie 
potential of bating analyzed ^to yield useful xnsights. However , 

the insights them^^^es' are not provided by lEP. Furthermore the 
descriptive appro^V^^^^^^^ basedvon the faculty activity report 
which has numeroxxs validity problems that destroy, the potential upe 
of its major contribution^- the calculation of imit costs. ^ Uafor-^ 
Itxmately this effort is probably inisdirected^since It only setves 
conceal the complex relattlonshipis between faculty -aCnd students^ 

* ■ . ■ • - ■ . » . . 

What lEP Does 

The lEP software and procedures are broken up into three 
modules which analyze imiverslty data in three areas - studety: 
recordis, 'faculty erfatt *and annual expenditures - and ccanbine them ' 
in a' f oxirtK module -which is used for the manipulation and reporting 
of data. All four modules allow user intervention to adjust outputs. 
A rjsrqulrement of th^ model is that all Inputs be classified by 

- program classification s'tructure^^jp^PCS.^ (attachment I) . 

Student DK^ Modiile (SDM) 

The; SI»1 has as i:tS\ Inputs the student records for the period 
under srMidy;^ It generates an Instructional Workload Matrix (IWLM) 
which eal^lates total student credit hours Caught at each dlsdlplin^ 
(deparCmrab) and level, and||^the total student credit, hoiirs taken in 
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each department by students In each. degi^ .program. This information 
is then, passed to the l^ata Management Moauie (DMM) . ^ . 

, • • » 

Patterson (1976) has descrlbjsd a method of inverting this in- 
formation t6 graphically describe the relative integration or 
autonoDty of eech department and its students into the curriculum 
of other departments . One use of this yould be assjcssment of the 
university -wide ioq>act.in terms o:f student credit hoTirs of deleting 
a particular degree program pr^. department . 

Personnel Data Module (PPM) 

. ' This module develops a description: of> the faculty activity in 
each department vhlch is, forwarded to the Accfoont Crossover Module 
(ACM) and used to cross each academic department's expenditures 
into tile program classification structure. 

Account Crossover Module (ACM) ' ■ 

The API has two purposes. If first adjusts departmehtal ledgers 
to conform 'to the standard definitions of Direct Costs as specified 
by NCHEMS. Examples would be removed of expenditures for utilities 
.frcm\each account otf , transferring equipment poirchases from a Dean*s 
or Vice President's account for a particiilar academic department. 
Basically this step compensates for v^lations in. accounting 
practices i^ch may occur between universities or even colleges 
within a single Taniversity. The second step, crosses the adjusted 
departmental expenditures into t^e" program classification structure 
based on the faculty activity analysis (for academie accovints) or 
a xaanual classification of activities (all other accounts) . ^ 
Expenditures by PCS genera teji by this step are thfen forwarded to 
tiie,lto. . ' 

Data Management Module (DMM) 

The DMM is used to display and relVte ind|ormat:iop generated by 
thfe previous modiiie^.- This involves : 1) the display of direct 
costs by activi^lgenerated by the ACM and PDM. 2) the allocation 
of expenditufeis in Support Activity Centers (physical plant, 
ticadenrij^'adminisiixationi the- .president ' s o'ffice, fitCj.) to Final 
Cost object-ivlei • 3ii^ruction\ research an^d. public service) and the 
calculation and^^display of Full (Direct plus Support^ costs of 
these centers . 3) The calculation of Direct and Full costs per* 
credit hoitt by did^cipliineo(d^^ and level of instruction. 

4) The cal^tiiation oF. the total costs and average student credit 
boujf costs fo^[ each -student degree program. . ' . 

. While dae varioTOS. moduljBS of lEP do produce- a variety of 
use^il reports , advances in ccaq>uter technology and the availability 
of highly^ fl€acible>.so'f%ware packiiges sucK as MAEK IV, Easytrieve, 
'etis^ have made it iaacreasingly easy to produce reports tailored to 

: . - .. - -2- • 



particular Issttea, reducing • the Importance of the generalized 
reports produced b7 lEP. Further, the main pxirpose of computer 
modU^Xing is to provide the capability of performing calculations ; 
or describing relationships which are too complex to dojby hand. \ - 
(Lee, 1973) . the main effort in and contribution of lE^ is 
.directed at allowing' the analysis of faculty activity to driye the 
distribution of faculty salazir^cross activities on an.* individual ' 
by Individual basis, and in tSv calculation of student program 
costs and unit costs. Ihif <»mnat«l^v n^'O'^^ous theoretical problems 
' cause both of these efforts- tH||e largely non-productive. 

Departmental Activity Analys'is " 

■^Probably the best description 0| a college or unlversl|:y ^' 
is a description of what , its faculty are doing" (Lelong, 1971; . 

In lEPy descriptions of faculty activity are used to spread* 
academic accounts into categories of instruction, research, public 
service , etc . (see PDH above) . The percent of these accounts 
moved Into instruction in a given discipline and. level has as great 
an Impact on discipline unit costs, and their derivatives,, student 
program costs and program costs, as the total amounts e^^ended 
from those accounts. Thus, the accuracy , of the descriptions of 
faculty, activity is a primary .factor in determining the quality of 
most outputs of lEP. Unfortianatel^ the quality Of such data Is 
usually bad. The "faculty iactlvlty report" approach mW^e implemented' 

at least two ways. Direct ojirsexrvations of- faculty cai be conducted, 
however, this approach Is too costly or bothersome to be done other 
than on a highly selective, sampling basis (Virginia, 1975). Where 
systemr or even, university-wide data is to be collected, a • 
'-'ques^ot^^ B^s problems. 

For example^ the distinction between teaching and research; activity 
is often unclear, if n.ot misleading, (many citations) Graduate students 
and som^ ^undergraduate students are often involved with faculty 
menibers £n research activities (Virginia, 1975) . In response to the 
Texas study ^on faculty workload (TACT, 1976) one faculty member 
replied, .••Although I listed time thus 'spent xmdef Research and 
Wirltlng, It -coiad be Jus^tlfied as class , preparation ; jny research 
is nearly all linked to my teaching specialties and is therefore a 
teaching preparation function." Similarly, federal agencies often 
aXlow graduate Instxructlon as cost-sharing for research grants. 



Co8C-8h«rlng instruction » as a result, may be Included under 
IiiHtructlon in studies of Institutional workload or costs, but 



may be included mder research preparation in indirect studies 
looking primarily at research costs (NACUBO, 1975; NACU^O/NCHEMS , 
1977) . To quote Hansen (1972) , *%ow does the professor separate 
out processes which .h^ considers inseparable? ... I should like 
to make the point here that professors and department chairmen 
are for the most part responsible people. They vant to respond 
to necessary questions if they are logical. By the same token, 
if ypxx ask them, to break ou:t^ processes they consider inseparable 
to programs (categories) they had no part in detepnining. Tou m 
Cannot expect serioxift responses, vising cooperation, or respect 
for your intentions/* Secondly, if the results of faculty 
activity surveys are used to reduce^budget or evaluate departmental^ 
programs, future surveys are likely to-^ becone very biased 'G^arden, 
1974). Thirdly, the faculty activity report is distributive, 
not a quant it lye measure. In other words it tells nothing about 
how h ard ^ -faculty in a particular departxn^nt are working. Finally, 
if a fSCulty activity report is instituted as an ongoing quarterly 
or annual project, it is not altogether unlikely that a long term 
degradation of the quality of the data reported will result. For 
exampla, filling out the report could eventiially be Regulated to 
depaftmentajL support staff and never even be seen by the professor. 

Ikifbrtmately the analysis of departmental activity performed 

* in the PDH does"^ nothing to address these issues. best it only 
addresses the impact of salary differentials between gradxiate 
students, and juzvLbr and isenlor faculty on the costs of activities 
peiffonaeid by each group. Even this may be misleading %lnce part of 
'the indirect cost^of tilthlergraudate instruction by graduate students 
is the educat£|^ of ^hoseVstudents by senior (Doctoral directive) 
faculty. X 

B^ond these problems , a distribution of ' departmental 
expenditures to all areas of faculty activity may not always be 
desirable. For example if unit- costs are being used as the basis 
f or a £undli^ formula^/ it m^ ^ desirable to consider the research 
and public -service activities of faculty as simply overhead costs 
. of instruction CTa^lezenberj^, 197^) . In other words, funding 
^ sufficient ..to provide a given level o^ free time to allow faculty 
to perform prof esslonlal activities is one necessary component of 
the recrultmei;it of faculty of a given caliber. -In this case all 
departmental costs would need to be distributed Jto instruction. 

The dlstrlbutj.on of departmental expenditures to a wide range, 
of activities may also cause*" problems if r^P prodiKts are used 
in reports to State G6vemment In out case, the higher levels of • 
expenditures reported '.in research, pxiblic sei^vlce, and academic 
support^ than produced' by other, less detailed approaches resulted 

• in an adverse reaction by the Governojr's office. ' , 
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the ChMBulatlon of Error In Complex Model^ 

''Long chains of argument are the delight of theorists and 
the soxirce of their mistrust by practical men." - (Alonso , 1968) . 

Much of the pioneer work In the practical applications of 
large scale models was done with urban growth and transportation 
Dodel8*for Urban and Regional Planning. The results of this 
.experience were -described as early as 1968 In the landmark, article 
"Predicting Best with Imperfect Data" by William Alonso - that 
complex models are more appropriate fdr. theoretical re^ifearch than 
for applied endeavors . This Is due to the cumulation of error 
In the model which occurs In fcvo ways, errors of specification, 
where the model does not mirror reality and errors of measurement. 
The most critical error of specification" for lEP lies in the 
■problems related to the "joint" or "common" products of thi activi^ 
of faculty (NACUBO, 1975, 1976j Bacchettl, 1977) whifh may* be 
unresolvable (Bacchettl, 1977). The errors of nteasurement chief ly • 
center around the accuracy and validity of the faculty activity 
reports and the "representativeness" of data from a particular 
time i^ejiod. Additional error results from more nxmdane problems 
such as. social seturity matches between salary and faculty activity 
records, PCS matches between student records and faculty activity 
records and the consistency across institutions of the types of 
operational decisions necessary in any large project (Bacchettl, 



. The exact way error cumulates was described by Alonso is a 
fxmction of the arithmetic operations of the model*. If Z if some 
function of X and Y where. X -10 + 1 ( + 10% ) and Y - 8 + 1 




(+ 12.5%) : 

Addition -v. 
~ ■ Z - X + Y 

. .. - . 18 = 10-+ 8 

2 2 2 
e = e + e = 2 
z X y ^ 

e = 1.4 

In the case of addition/ the absolute magnitude of error is 
greater (1.4 vs 1.0) however, the percentage error is smaller 
(7.8% vs 10% and 12,5%) than is the independent variables. Addition 
is relatively benign. 

-5- 
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Stibtractlon 

X - Y 

2-10-8 

2 2 

« - • +e -1 + 1- 2; e :-1.4 
2 X 2 



■ ' ■ t . 

Thf restilt of stibtractlon Is the same absolute error as 
addition of the same variabiles. The relative error, hoi'ever, 
is explosive (70X vs lOZ and 12.51) 

Multiplication and Division 
Z — XY • 
. 80 - 10 X 8 

p . ■ > . ' • • . ^ 

2 2 2 

e - e + 2 W - 164; e - 13.3 
2 X Y . Z * 

Multiplication not only greatly raises the absolute error » 
but also raises the relative error to some degree (16.9%). 
Divison behaves exactly like multiplication.. 

lUising to a Power 

, Z - X^ . . 

100 - 10 

' 2 2 / . ^« 

e -°(2X) - e - 400 : e - 20 

_ ^' ; X 2 

Rais.ing to a power, described by j^onso as the multiplication 
of perfectly Intercorrelated variables, is another explosive 
operation. In this case relative error reaches 20 percent.* - 

From these eqtiations , Alonso generalized the following rules • 
for building or choosing models: 

1* Avoid intercorrelated variables. 

2. Add where possible. 

3. If you cannot add% multiply or divide. # 

,4. Avoid as far as possible taking. difference^ orv raising 
variables to a power. - 
5. Avoid as far as possible models which proceed by chaiiu^. 



« 

Ttkm la»t polafc ha» pTttculT rf l«vnc« for lEP at Itt prt— ry » 

oucpucs, di*cipisn« costs p«r credit hour andjto an «v«n sr««t«r ' ~ 
•xc«nt» stuftent program total and avaraga eosta par cradlt hour 
ara tha products of long chains of calculations. Thus tha liaccind 
major conrrfhirfon of lEP has significant prohlams and may ganavata 
xBora **nolsa" than raal< af facts . 

« 

Kajor problams aalda, tha unit costs ganaratad by lEP art 
iopactad by significant varlablas vfalch ara not cbntrolXad by tha 
study. Current inflation ratas craata problama with ths compariaon 
of axpandltura data ganaratad in dlffarant yaars. or in diffarant 
areas of tha countrr. Furtharmora, funding adjustments b^ state 
legislatures nbt only rarely keep up with inflation, but the exact 
xelatlonshlp between percentage Increase in funding for it particular 
year and tha percentage Increase in inflation for that year is ; 
itself variable in nature. At its most extreme case, state revenue 
Droblems .may cause a hiatus in raises and funding Increases for a 
limited period, causing a highly misrepresentative/ support dallars/ 
-workload relationship for any expenditure analysis conducted during 
that year. 

The expenditure/enrollment relationships described by direct 
unit costs are to a large degree a description of the relationship 
between departmental staffing - the largest cause of imiversity 
expenditures - and enrollment. Unfortunately, this ratio is not 
extremely stable, particularly for ptiblic Institutions. .For example, 
although the recent total enrollments at FSU have fluctuated no 
more than 3X from the previous year, fluctuations at the depart 
mental level have . averaged approximately lOX per year. Further, 
short term (annval) fluctuations are not always in the same direction 
as long term trends. Because of the delays required for recrvfltment 
and the ^act that faculty resouxces are necessarily budeeted prior 
to the academic year, staffing changes must respond to long term^ 
trends. This is further complicated in a steady state and collective 
bargaining situation because realloeations of faculty positions are 
contingent upon faculty turnovers which are outside^ the control of- 
central tHUverslty administration . As a result , there could eas ily 
be a two or three year lag between enrollment shifts and resultant 
staffing adjtistments. In the 'case of a department wit^ declining . 
enrollments this lag could be even greater and result in a dramatic 
increase in unit costs. 

lEP* shares many of the problems of the large scale models used 
and abandoned byjthe field of Urban and Regional Planning 'in the 1960 's 
(Alonso, 1968; lS&7l973i Nayler and Jeffrcss, 1975). , 

1. It is "designed to -replicate too complex a system in a . 
^ single shot "CLce, 1973; in reference to Urban "knd Jlegional Planning' 
• models) While the^ total departmental expenditures and enrollments 
by department and level analyzed by ^P ixi a particular yif&r are 



bSrobably an acc\irattf r«pr«f«cit*clon of that.yaar, th«y art a snapshot, 
look i^a dynamic situation and may not b« raprasantativa, or 
gantoal^faprasantftlva unit costs. This problam could probably ba. 
controllid by avaragiAg data ovar savaral yaars as could tha 



problam In, th^ ralatlonshlp batwaan Inflation and funding for ■ a 
particular year. Fxirthar, .atandardlsad procaduras for controlling * 
thasa aotircas of varlanea could probably ba davalopad; hcwavar,. this 
would only sarva to maka an alraady conplax projact avan mora complax. . 
Fur.tharmora, any adiustmanta would atlll ,laava tha ralatioaahlp 
batwaan dapartmantal axpandltUras and atudant cradlt hour productivity 
daaerlbad only In tarms of a dtsrrlhlrtnft ^baaad on faculty affort. and 
atudant cradlt hours by dapartisant and laval. Issuas such aa 
faculty contact hour loads, faculty/squlpment ratios. Instructional ^ 
mode, qualitative measures of students, full-time, part-time student 
ratios, qxiallty of instruction, etc. are Ignored. 

2. .Although "excessive data Is required ... to provide 
microscopic detail, the actual level of detail is much too coarse 
to be of use " (Lee, 1973). 

The data reqixirements of lEP lnclx«ie a stxxdent data^j^le con- . 
taining the degtee program and department discipline and l)evel of 
all credit hours taken during the year of ^ach stiident ano an 
estimate of the distribution of each faculty member's activity 
across disciplines and levels of instrixction, and variotis research, 
piibllc scnrvlce and academic support activities. Despite the detail* 
of the inputs, the outputs all derive from a single analysis which, 
as^ discussed above , have a variety of problems . 

3. Bxxlld only very simple models. Complicated nodels do not 
work very well, if at all ..." (Lee, 1973). • / 

Since lEP has as its purpose the exchange of data between 
institutions, it needs to be widely adopted. Unfort\mately its 
conplexity and resultant cost restrict i,ts adoption. On the othct 
ha^, coaq>lex models place high^emands on the ouality of data 
(Alonso, 1968; Lee, 1973) which are not met by faculty activity 
data (Hansen in Stewart, 1972; Virginia, 1975; Kansas, 1975; 
NACUBO, 1975). * ' 

4. ""... <the strategy Is not to build one master model of 

the real world,, but rather a set bf weak models as altex^tive models 
for the 'same set of phenooend. Their intersection will produce 
robust theorems."- (^lonso, 1968^. . ^ 

It' seems quite likely that Alonso* s. comsents directed at models 
in the fiield of Urban and Regional Planning are relevant to Higher 
Education. 'One possibility would be the development a^d exchange 
of departmental profiles containing. whatever information is easily 
available from university data filers and budget reports, such as 

• =■ • 
-8- • 
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^wnt.«t hour ;Lo«<lt «y«r«ga.cUft flscf. fupporc itrnff/faculty 
^T^i'^^TJ'.^'T^^"" o^r•.ourc•. on th« part S^IcuJJJSS 
^Mu^I^nt! P'''*'^*" coiBpouaSlng .rrofS of 

bv lEP^'iil cotl. «nd umt costs g«n«r«t«d 

^JS** «• probaki^ not stable enough to produce 
consljtently valid results. J^te^nnore the comolexltv of th« 

thi'^JoirS^*^ ^i^lndices .S?Ss to^oioS^d 

the jrrors of neasurenent of the Inputs. On the other hSd 
insufficient detail is provided to determine the cauIL S the " 

^srSr^s^j's? r^y- r^^ «x.«pir^:xces%iC^'"s?. be 

iu5oS5f^^?!^?5i:*'^«? salaries high faculty/ stutient ratios, high 
. support staff /faculty ratios- or some other condition Hiih costs 
merely^indlcate that further examination of departmSiltal fitriJ 
S"Ai«7.V4 comparative data is needed fSr Sis Jnd^toce 

the calculation and examination of more objective data such as lhat 
f^«^;!!f/?r*^f probably cuicker. easier and ult sSbJe" ^o 
error than the calculation o? unit Colits, why bother wfth unit costs? 

the 'va??f Mn^'fi"^"?^ the ^ above problems along with others such as 
5?J,Jf« "jJ'* costs duetto the m£x of tenured vs. nontenured 
fSfyi^;.^**\?w^''^**'^^^°" of,foculty among r-anks, Ir the dSp^tment 
chairman s ability, to cover ntJSerous courSes uslAg^art-t^ 
u'n?fl«"?''?i (adjuncts) bring iSTback to tlNr unaolSaSu pr^cm 
¥Se ?lp if i*uJh?rJ^T coa^arisoo. are. quest i^ble." 

• ! * usable- tool only when very similar institutions are 

?eSislItor« ""t '^^^ solvedlhl queati^Sfasked^y III 

s'^'le^qSIstlons"' .'^ answers^o 
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